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SYSTEM AND METHOD FOR SIMULTANEOUSLY DISPLAYING 
VIDEO PROGRAMMING AND INSTANT MESSAGING 

BACKGROUND OF THE INVENTION 
5 [0001] Instant messaging has become a popular forum for exchanging messages and 

information among computer users. While popular, it has some drawbacks. For example, the 
instant messaging screen used for sending and receiving information typically identifies the 
person posting any message next to his/her message, but it may not reveal other conditions 
pertaining to the message or its sender. For example, if the sender is engaged in a second 
10 activity (such as watching a TV program) at the same time as sending and receiving instant 
messages, the recipient may not know about the second activity unless told by the sender as 
part of the message. 

[0002] Currently available instant messaging (IM) applications have other characteristics 
that limit their use as a complete form of communications. For example, while it may be 
1 5 possible to initiate a voice conversation as part of the IM application, such voice 

communications are implemented using a communication channel established by an IM 
server over the internet. Each user must have the proper software and hardware for 
participating in the voice communications. Such communications may not use conventional 
telephones and the PSTN (public switched telephone network). 

20 [0003] Also, while it is known for people using email and instant messages to send 

attachments with their messages, there can be problems surrounding the attachments. For 
example, if the sender attaches a video clip of a TV program or movie, the recipient may or 
may not be a subscriber to the service ( e.g., premium cable TV channel) from which the 
video clip was obtained. 

25 [0004] Further, while IM applications have the capability of collecting data concerning 
those sending and receiving messages, there has not existed a convenient manner of 
collecting that data and using it for purposes of understanding the habits or needs of users. 



BRIEF SUMMARY OF THE INVENTION 
[0005] There is provided, in accordance with the present invention, a display system for use 
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communications network, the display system having a display device, and plural display 
windows at the display device, the plural windows for simultaneously displaying multiple 
5 content to a viewer, wherein a first display window displays video programming content and 
wherein a second display window displays content from an instant messaging application. 

[0006] In another embodiment, the video programming content is a broadcast television 
program provided to the viewer over one of a plurality of selectable television channels and 
wherein the instant messaging content includes a program ID for identifying the broadcast 
1 0 television program being viewed by instant messaging (IM) users. 

[0007] In another embodiment, the instant messaging content further includes a selectable 
telephone communications element, and wherein a telephone communications line is 
established over the communications network between the viewer (the user at the display 
system) and a remote IM user having his or her personal ID displayed as part of the instant 
1 5 messaging content, when the telephone communications element is selected by the viewer. 

[0008] In yet another embodiment of the invention, the viewer is a subscriber to video 
programming content received over the communications network, the viewer is assigned one 
or more security keys in order to display the video programming content, an electronic 
message sent by the viewer to a remote IM user includes a video data file attachment 
20 obtained from the video programming content, the video data file includes a security key 
associated with the video programming content, and the video data file is displayed for the 
IM user only if that user has a security key matching the security key associated with the 
video programming content. 

2 5 BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 is a simplified view of a network in accordance with one embodiment of the 
present invention. 

[0010] Fig. 2 illustrates a portion of the network seen in Fig. 1 . 

[001 1 ] Fig. 3 is a block diagram illustrating the components of the set top box (STB) seen 
30 in Fig. 2. 
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[0012] Figs. 4 through 6 illustrate various screen displays seen on a TV screen as part of an 
instant messaging (IM) application, and implementing one embodiment of the invention. 

[0013] Fig. 7 is a flow diagram illustrating a program process carried out within the STB 
seen in Fig. 3, in order for an IM user to make a telephone call to another IM user. 

5 [0014] Fig. 8 is a flow diagram illustrating a program process carried out within the STB 
for sending a video file from one IM user to another. 

[0015] Figs. 9 and 1 0 illustrate functionality within the STB of an IM user for decrypting 
video program signals, and providing a key for use with a video file attachment that is to be 
sent to another IM user. 

1 0 [0016] Fig. 1 1 illustrates a database management system for use with an IM server, in order 
to collect and report data at the IM server, such data associated with IM users. 

[0017] Fig. 12 illustrates a report on IM activity and TV watching habits, that could be 
generated by the database management system of Fig. 1 1 . 

1 5 DETAILED DESCRIPTION OF THE INVENTION 

[0018] There are various configurations and embodiments implementing the present 
invention. One such implementation is shown in Fig. 1, where a communications network 
100 has a subscriber premises 1 10 connected by a network interface device (NID) 1 12 to a 
service provider networkl20. The NID 112 serves as demarcation point and interface 

20 between a twisted pair drop cable 1 60 and the twisted pair and other wiring (and equipment) 
within the subscriber premises. In the embodiment illustrated, the subscriber receives VDSL 
(Very high data rate Digital Subscriber Line) services from the service provider, whereby the 
subscriber is provided internet access at a personal computer 130, receives video 
programming (such as video-on-demand) and other information for display at a television 

25 132, and has telephone or voice service at one or more telephones 134. 

[001 9] The network illustrated is a fiber-to-the-neighborhood (FTTN) distribution system, 
with a central office 150 having optical fiber lines 154 (e.g., OC-3 to OC-12c) extending to a 
universal system access multiplexer (US AM) 156, which in turn is connected to the 
subscriber NID 1 12 via the twisted pair copper wire 160. The arrangement seen provides a 
30 dedicated VDSL loop between the US AM 1 56 and the subscriber, using an existing POTS or 
telephone system twisted pair. A residential gateway or set top box (STB) 166 at the 
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subscriber premises provides a connection point (electrical connections, encoding/decoding, 
multiplexing, etc.) between the network and the various customer devices (e.g., PC 130, TV 
132 and telephone 134). While shown as separate components, the NID 1 12 and the STB 
166 could be combined to perform all subscriber interface functions within a single unit. 

5 [0020] The fiber optic lines 1 54 running from the US AM 1 56 connect to a high bandwidth, 
host digital terminal (HDT) 170 within the central office 150. The HDT 170 receives various 
digital signals containing video, data and voice (from various sources -- to be described) and 
combines those as a broadband signal to the subscriber over the twisted pair drop cable 160. 
Bi-directional connection paths or channels connect to the HDT 170 and carry (1) voice 

10 signals to/from the public switched telephone network (PSTN) 180, directly or through a 
digital telephone switch 182, (2) video signals (and appropriate video command and control 
signals) to/from a video headend system 186 provided by a video information provider, and 
(3) data to/from the internet 190. The VDSL network as thus far described is well known, 
and the various systems, components and interfaces used in implementing such network are 

15 available and established by various standards bodies, telecommunications service providers 
and manufacturers of VDSL equipment. 

[0021] Using the network 100 (or any other internet access network and service) for 
accessing the internet obviously connects the subscriber to a vast network of information 
providers and their servers, and one such server - an instant messaging (IM) server 192 - is 

20 shown in order to further illustrate various embodiments of the present invention. The IM 
server 192 is of the type operated by any one of many commercial instant messaging service 
providers, such as AOL®, Yahoo!® and MSN® (AOL is a registered trademark of American 
Online Inc., Dulles, VA, Yahoo is a registered trademark of Yahoo! Inc. of Sunnyvale, CA, 
and MSN is a registered trademark of Microsoft Corporation, Redman, WA), and works in 

25 conjunction with the subscriber's equipment to permit receiving, displaying and sending 
instant messages among subscribers that have, for example, formed a "buddy list" for such 
purpose (a "buddy list" is a list or group of users that have collectively selected each other, 
and that communicate with each other within that group via instant messaging). 

[0022] Before leaving Fig. 1, it should be noted that in one embodiment of the invention, 
30 the television 1 32 at the subscriber premises 1 1 0 will be used to display not only video 
programming content delivered over the communications network 100 to the subscriber 
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(originating from headend 186), but also to display instant messaging content using 
applications, information and services provided by the IM server 192. 

[0023] Turning now to Fig. 2, there is shown in greater detail the equipment within the 
subscriber premises 1 10 that may be used in implementing one embodiment of the present 

5 invention. In particular, there is shown the set top box (STB) 166, receiving broadband 

signals from a twisted pair line 212 coming from the NID 1 12 (Fig. 1). As mentioned earlier, 
the signals passing through the NID (provided over the twisted pair drop cable or line 160 
from the USAM 156 - see Fig. 1) contain voice, video and data originating from any one or 
all of the PSTN 180, internet 190, and video headend system 186. The relevant functions 

10 within STB 166 will be described later, but briefly video, data and voice signals present in the 
broadband signals on line 212 are separated. Video (and companion audio) signals are 
usually received in an encoded format (e.g., MPEG-2) from the line 212, and are converted 
by the STB to an analog or other format suitable for a conventional television set and 
provided over line 214 to the TV 132. Voice signals are provided to telephone equipment 

15 over a telephone (bi-directional) line 216, and data signals are provided over a bi-directional 
line 218 to one or more personal computers. The STB 166 is powered by a suitable power 
source, such as household AC power. 

[0024] The TV 132 has a display screen (CRT, LCD, etc.), with the display operated to 
include a primary window 222 for displaying video programming content (originating from 

20 the video headend 1 86), and a smaller, secondary window 224 for displaying instant 

messaging screens. As will be described later, the STB 166 acts as a client (having its own 
processor and memory), running a java-capable or other suitable browser that is programmed 
to use an instant messaging application or applet downloaded from the IM server 192. Thus 
for instant messaging functions programmed into the STB processor, including sending, 

25 receiving and displaying instant messages and related content, the STB will communicate 
with the IM server 192 to perform such instant messaging functions, and the instant 
messaging screens used for such functions are displayed on the secondary window 224 and 
overlay the video programming on the primary window 222 of the TV 132. 

[0025] The size, shape and format of the windows 222 and 224 may change to suit the 
30 preferences of the user. While Fig. 2 shows them as overlapping, it should be appreciated 
that for ease of viewing, the secondary window could have a vertical or horizontal shape on 
one side of the display screen, so that the primary window 222 can be resized when 
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secondary window 224 appears (in order for the video programming on the primary window 
to not be obstructed by the secondary window). 

[0026] It should be noted that the PC 1 30 receiving data signals over line 2 1 8 may also 
have an instant messaging application applet downloaded from the same or a different IM 

5 server 1 92. However, such instant messaging functions and the corresponding screens are 
displayed at the PC 130 rather than the TV 132. The STB 166 may include a conventional 
router function that recognizes the IP addresses appended to messages received at the line 
212 (and originating over the internet), and routes those messages to the client within the 
STB when they are addressed to the instant messaging application running within the STB, 

10 for ultimate display of instant messaging screens at the TV 132. Of course, IP addresses 
appended to messages intended for the PC 130 (whether as part of an instant messaging 
application or any other application on the PC) are routed by the STB to the PC over line 218. 
While not specifically illustrated, it should be appreciated that the STB as a client may also 
run applications other than instant messaging applications, and such applications or applets 

1 5 may also have information displayed at the TV 1 32. 

[0027] The STB 166 works with two user interface devices, a remote control 230 and a 
wireless keyboard 232. Both remote control 230 and wireless keyboard 232 may use 
conventional infra red techniques to communicate with the STB 166. The remote control 230 
may have conventional controls or buttons for controlling the operation of the TV 132 for 

20 viewing television programming. The keyboard 232 may likewise be a conventional device 
for controlling the client in the STB, in order to enter data and otherwise interact with any 
application controlling the secondary window 224 on the TV, which as mentioned earlier, 
may be used to display instant messaging content. While the remote control and keyboard 
are shown as separate devices herein, it will be appreciated that they could in fact be 

25 integrated into a single device for both controlling televisions programming and entering 

data. While not illustrated, other user interface devices (e.g., a mouse, roller ball, etc.) could 
also be used for controlling the STB 166. 

[0028] The internal features of the set top box 1 66 are illustrated in Figure 3 . In this 
example, the STB 166 is controlled by a central processing unit (CPU) 312, which is coupled 
30 to an Application-Specific Integrated Circuit (ASIC) 313. The CPU executes software 

designed to implement various functionality performed at the STB, in conjunction with the 
ASIC 313 and other components. The ASIC 313 also operates in conjunction with the CPU 
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312 to interconnect various components to the CPU and operate the TV 132 in a well known 
manner. Connected to the ASIC are memory devices, such as a ROM 314 (e.g., for storing 
code used by the CPU), a RAM 316 (e.g., for storing digitized TV signals so that they can be 
processed by the CPU 3 1 2 before viewing, in order to provide, among other things, shared or 
5 split screen viewing), IR interfaces 3 1 8 and 320 for the remote control 230 and wireless 
keyboard 232, respectively, and a VDSL interface 324 for receiving VSDL signals from the 
NID 1 12. A mass storage device 330 may be used for storing data and applications, and can 
be any suitable medium for storing machine executable instructions and data, such as 
magnetic disks, optical disks, and the like. Also within the STB 166 are an audio digital-to- 
1 0 analog converter (D AC) 328 which provides audio output to the TV 1 32, a video 

encoder/decoder 332 which provides video output to the TV 132, a telephone interface or 
modem 334 for passing voice signals to/from the telephone 134, and a data interface or 
modem 336 for passing data signals to/from the PC 130. As should be appreciated, the 
telephone interface 334 may have multiple telephone ports, in order to accommodate multiple 
1 5 phone lines (each with a different phone number) within the subscriber premises, as well as 
the ability to connect several telephones to a single port (for multiple telephones/extensions 
sharing a single phone line). Furthermore, the data interface 336 may have multiple data 
ports in order to permit connection of more than one PC 130 to the STB 166. 

[0029] The CPU 3 1 2 runs a j ava capable browser stored in the memory of the STB in order 
20 to download an instant messaging application. The instant messaging application may be 
used by the subscriber to display instant messages and related content from other instant 
message subscribers, such content displayed in one embodiment on the secondary window of 
TV 132. However, before displaying the content, it is necessary for each user to establish a 
profile. Such profiles are set up in a well-known manner to those familiar with instant 
25 messaging, by entering personal data (e.g., via keyboard 232) pertaining to the user. 

However, in accordance with one embodiment of the present invention, certain profile data is 
established to enable users to communicate in a manner augmenting the conventional entry 
and display of data on an instant message screen. In particular, users will enter telephone 
number information so that while communicating with other users on the subscriber's 
30 "buddy" list, the user can initiate a telephone call to discuss the content of their instant 
messages. This entry can be done in advance of posting the instant messages, e.g., when 
setting up a user profile at the IM server 192. The manner of entering telephone information 
is illustrated in Fig. 4, where a profile screen is illustrated for setting up or joining an instant 
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messaging group or "buddy list", or otherwise permitting one to establish himself as an IM 



user. 



[0030] Turning to Fig. 4, there is shown a screen 410 for entering the personal profile 
information of an IM user (i.e., a person who desires to send or receive email within an IM 
application). As can be seen, the screen includes fields for entering information on the user, 
including a "User ID" field 414 (the ID displayed with an instant message), "Real Name" 
field 416 (the actual real name of the user), "Location" field 418 (a city name or other 
geographical information concerning the user), "Age" field 420, "Marital Status" field 422, 
"Gender" field 424 and "Occupation" field 426. The forgoing fields are those commonly 
used by people to establish themselves as users within an IM application and make 
themselves available to be added to "buddy lists" set up by that user or others (additional or 
alternative fields could, of course, be employed depending on how the IM application will be 
used). As illustrated in Fig. 4, the profiled user has provided a User ID of "jsmith", having a 
Real Name "James Smith", living in Denver, Colorado, and being a 22 year old, single, male 
student. 

[0031] The information in the profile (or portions of it) can be designated as "public", that 
is, revealed to all other users in order for them to decide if they want the profiled user 
included in their buddy list, and to organizations such as commercial entities that may use the 
profile information (and other collected data -- to be described) for commercial purposes. 
Alternatively, the information (or portions of it) may be designated as private, meaning that it 
is made available only to the user setting up the profile, or to others that the user has selected. 

[0032] In one embodiment of the invention, the profile screen 410 includes a "Telephone 
No." field 428 and a "Profile Public/Private" field 430. The "Telephone No." field 428 
permits the user to enter and the IM server to store the personal telephone number of the 
profiled user (standard 10 digits - North American Numbering Plan), and ultimately permits 
other users to telephone the profiled user during an instant messaging session (as will be 
described in greater detail later). The "Profile Public/Private" field 430 permits the profiled 
user to designate his/her information as public or private (in the illustrated screen of Fig. 4, 
the user has designated his information as public). 

[0033] It should be appreciated that the STB 1 66 may store and manage multiple profiles 
so that each household member at the subscriber premises my separately use the IM 
application with his/her own profile and preferences. A screen (not shown) may be initially 
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presented for each user to identify (using keyboard 232) himself and thereby use his profile 
and preferences. The STB may also be programmed to default to one user if he/she is the 
principal user of the IM application. 

[0034] Fig. 5 illustrates a session set up screen 510 used by a user when setting up an 
5 instant message session with people on his/her buddy list. As illustrated, the user having the 
ID "jsmith" has two buddy lists, "List No. 1 and "List No. 2". List No. 1 is illustrated as 
having four other users who are part of the list, and List No. 2 has two other users. Either list 
can be selected or clicked to permit "jsmith" to log on or join that instant messaging or chat 
session (as seen in Fig. 5, List No. 1 has three of its members logged "on" and one logged 
1 0 "off, and List No. 2 had both of its members logged "off). In addition to identifying each 
user, screen 510 displays the TV program (if any) being currently viewed by that user. 

[0035] As also illustrated in Fig. 5, the screen 5 10 has two fields for implementing certain 
embodiments of the present invention. An "Accept Calls" field 516 permits the user to either 
accept telephone calls from other users on the selected buddy list, or not accept those calls. A 

1 5 "TV Show " field 5 1 8 permits the user to enter the name of the TV show or program that he 
is watching while he is present in the IM session. In the embodiment shown in Fig. 2, the TV 
program may be the program displayed on the primary window 222 of the TV 132, while 
screens from the instant messaging application are displayed on the secondary window 224 of 
the TV 132. (While not shown, screen 510 could be pre-programmed to list TV programs or 

20 channels, so that the user may select the one being watched.) Various examples of using the 
TV programming identification will be described shortly in conjunction with Fig. 6. 

[0036] It should be mentioned that while the embodiments of the invention described in 
connection with Fig. 5 are illustrated with the user entering the name of TV programming in 
field 518, alternatively such programming information could be captured electronically at the 

25 STB 166. That is, the STB 166 will receive programming ID information along with the 
actual programming content, as part of the standard MPEG-2 formatted signals from the 
video headend 186 (Fig. 1), and if an IM application (implementing the present invention) is 
running at the same time on the CPU 3 1 2 within the STB 1 66, such programming 
identification can be captured and stored automatically by the IM application. This 

30 arrangement, of course, permits the IM application to recognize a change in the programming 
content or channel (such as a result of the user changing TV channels) that may occur during 
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the IM session, and dynamically change the displayed TV programs ID without the user 
having to return to screen 5 10 and manually change the TV program ID or name. 

[0037] Turning now to Fig. 6, there is illustrated a message display screen 610 that is 
displayed after a buddy list has been selected by the user (in the screen illustrated in Fig 6, 
the screen illustrates messages from all the users who are part of "List No. 1" in Fig 5, and 
each of those users sees the same screen format). The message display screen 610 will 
appear in the secondary window 224 of TV 132. The message display screen has two 
windows or subscreens, a sent/posted message subscreen 614 for displaying all messages that 
have been sent by all of the users, and a message composition subscreen 616 that is used in 
order to compose messages before they are sent (by selecting a "Send" button 618) to all the 
other users. As seen in Fig. 6, each message has four components, namely an "ID" 
component 622 displaying the ID of the message sender, a "TV Show" component 624 
displaying the name of the television program that the sender is watching (entered for 
example, at screen 510 in Fig. 5), a "Message Content" component 626 showing the actual 
15 content of the sent message, and a "Call" component 628 having for each message a 

telephone icon or button (graphical element) that can be selected to permit the user viewing 
the screen to telephone the sender of that message (assuming that the sender has decided to 
accept calls at field 516 in Fig. 5). As conventional, attachments (text, audio, video) can be 
included with a message and, although not illustrated in Fig. 6, an attachment icon can be 
20 displayed with the message to indicate the presence of the attachment. 

[00381 The screen 610 also has a Send Video File button 640 for sending a video file 
attachment to any message composed at subscreen 616 (the details of such attachment will be 
described later). 

[0039] Thus, it can be appreciated that the user of the IM application implemented by the 
25 screens of Figs. 4, 5 and 6 is not only able to see messages from other users on his/her buddy 
list, but also see which TV program each user is watching. This facilitates "real time" 
conversation (via email messages) concerning the TV program as part of the instant 
messaging session. Further, the user can select the "Call" button at any message in order to 
initiate a telephone call to the sender of that message so that, among other things, the user 
30 selecting the "Call" button and the sender of the message being called, may also have a "real 
time" voice conversation about the particular TV show being watched (as well as any other 
subject) at the same time as they are each viewing the message display screen 610 in Fig. 6. 
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[0040] It should be further appreciated that other embodiments may use variations of the 
screens seen in Figs. 4, 5 and 6. As one example, rather than a chat session involving a group 
of users from a predefined buddy list, a user may be messaging only one (or a few) individual 
users (that are not part of a buddy list). While the screen 610 in Fig. 6 might, in such 
instance, show only one other user and his/her messages, the screen 510 in Fig. 5 can be 
selected for simultaneous display so that the user may still monitor (separately) other users in 
the buddy list(s), their status ("on'Voff ' ), and which TV show they are each watching. While 
not illustrated in Fig. 5, the screen 510 could also include a call button (similar to call button 
628 in Fig. 6) so that a call can be initiated to any other person on the buddy list using screen 
510, even if such person is not part of an active instant messaging session (screen 610). 

[0041] Turning to Fig. 7, there is shown a flow diagram illustrating the process and 
associated program steps (implemented within STB 166) for making a telephone call by 
selecting the Call button 628 seen in Fig. 6. After the Call button has been selected at step 
710, the IM application running within STB 166 checks profile information of the selected 
user (which has been downloaded by the IM Server 192 into memory within the STB) to 
determine (step 712) whether the person to be called is accepting telephone calls (such 
information was entered at field 516, screen 510 in Fig. 5, when that person joined the IM 
session). If the person is not accepting calls, a message to that effect (not shown) is displayed 
on the TV 132, at step 714. If the person is accepting calls, then the IM application at step 
718 reads the telephone number stored with the profile information within the STB memory 
(such number was initially entered when the person set up his/her profile at screen 410 seen 
in Fig. 4). The IM application then determines the correct dialing format of the telephone 
number to be called, step 720. This last mentioned step is necessary because the actual 
number to be dialed may have a format different than the format entered at screen 410. 

[0042] This last mentioned step 720 may involve one or more subprocesses, depending on 
the nature of the number stored for the person being called. For example, all numbers are 
entered in a ten digit format as seen at screen 410 (three digit area code plus seven digit 
phone number). Two lookup tables within the STB can be used to determine the proper 
dialing format needed to make the call. As an example, lets assume the person being called 
lives in the same area code, and a seven digit number (without area code) is used to make the 
call. The STB will be programmed to convert the telephone number stored (ten digits) to 
seven digits by dropping the area code before dialing the number. Similarly, if the call is a 
long distance call, requiring that a "1" precede the ten digit number when dialed, the STB is 
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programmed to include the "1" in the dialed number. The following Table 1 illustrates 
several different algorithms stored in STB 1 66 and that can be used to convert the stored 
telephone number into an appropriately formatted number for dialing: 

TABLE 1 



Algorithm 
Index 


Algorithm 
Name 


Algorithm Description 


0 


1 + 10D 


Dial out 1 followed by the last 10 digits 


1 


7D 


Dial out the last 7 digits 


2 


10D 


Dial out the last 10 digits 


3 


1 +7D 


Dial out 1 followed by the last 7 digits 


4 


5D 


Dial out the last 5 digits 



[0043] Further, the following Table 2 illustrates an excerpted portion of a look-up-table that 
can also be stored in the STB 166 for determining which of the algorithms (such as those in 
Table 1) should be used to dial the called number: 

TABLE 2 



Algorithm Index 




201 

202 

203 

204 

205 

206 

207 

208 

209 

210 

301 

302 

303 

* 



0 

0 

0 

3 

2 

0 

0 

0 

0 

0 

0 

0 

1 
* 

* 
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[0044] Thus, based on the area code of the number to be dialed, the STB 166 will use the 
stored ten digit phone number, and reformat as necessary to complete the call over the PSTN 
180. 

[0045] A more complete description of a system and apparatus for properly formatting a 
5 dialed number from a stored telephone number (e.g., when the stored number is in a ten digit 
format), can be found in U.S. Patent No. 6,597,785, entitled "Automatic Caller ID Call Log 
Dial Back", issued to Burke et al on July 22, 2003, which is hereby incorporated by reference. 

[0046] After the correct dialing number is determined, the STB 166 waits for a dial tone 
(step 722) at the telephone connected to the STB and that the user will use to make the phone 
10 call (most likely in close proximity to TV 132). For example, if there are several phones 

(extensions) throughout the subscriber premises, and someone other than the user is using one 
of the other telephones within the premises, the STB may be programmed to display a 
message at the TV indicating that the line is busy or that no dial tone is available. The STB 
can also tell the user through the display that the number will be dialed when the phone line 
15 becomes available (the user can decide whether to wait or cancel the call request). 

[0047] After a dial tone is detected at step 722, the user is instructed (by display at the TV), 
to pick up the telephone, step 724. Once the STB detects that the telephone receiver has been 
picked up, the STB dials the correctly formatted number (step 726), and when the telephone 
receiver at the called location is picked up, the call is completed (step 728) and the user at the 
20 dialing location and the user at the called location may then have a telephone conversation 
(which in the illustrated embodiment is carried over the PSTN 180). 

[0048] It should be noted that the forgoing feature for calling a sender of an email message 
could be implemented in many other ways. For example, if the central office switch 182 
(Fig. 1) implements AIN (Advanced intelligent Network) functionality, the STB 166 could 

25 dial the telephone number of the user to be called, and the switch 182 could call back the 

calling user as soon as that call can be completed. Further, the telephone call could be made 
using IP telephony (using the internet), and the switch 182 could be bypassed altogether. 
[0049] Fig. 8 is a flow diagram illustrating the process flow and associated program steps 
by which the IM user at the subscriber premises 1 10 may provide a video file to another IM 

30 user. Fig. 8 will be described in conjunction with Figs. 9 and 10, which illustrate functional 
features within STB 166 used in encrypting and decrypting video files and keys as part of the 
process of Fig. 8. In Fig. 8, the user first selects (step 810) the Send Video File button 640 
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seen in Fig. 6. In one embodiment, the user may merely select (step 812) from video files 
that have previously been stored by the IM user within the memory of the STB 166. Such 
files are stored in an appropriate format, such as MPEG-2. However, the user may also select 
a file to be created or that is currently being created, such as a file or video clip of the 
5 program that the user is currently watching at TV 132. Systems and services for storing 

video programming currently being viewed or broadcast are those marketed by TiVo (TiVo is 
a registered trademark of TiVo, Inc., Alviso, CA). Such a system is described in U.S. Patent 
No. 6,233,389, entitled Multimedia Time Warping System, issued to Barton et al. on May 15, 
2002, which is hereby incorporated by reference. If such a system were employed, TV 
10 programming currently being viewed at TV 132 is simultaneously being stored in memory, 
and the user sending the attachment could identify a TV show or portion thereof that might 
appeal to another user as he or she is watching it, and use the stored file of the TV program as 
an attachment to an instant message created as the TV program is still being watched. 
[0050] It should be appreciated that depending on the source, the video file to be shared 
15 may be stored in a proprietary format (e.g., other than MPEG-2) at the STB 166. For 

example, if the file is created using the previously mentioned TiVo system, such file would 
be in a TiVo proprietary format and may be stored at the STB in that proprietary format. The 
file may be re-formatted (to MPEG-2) by the STB when shared with others, or shared (sent to 
another IM user) in the stored proprietary format if the destination STB is programmed to use 
20 that proprietary format. 

[0051] After the user has selected a video file, the STB may also attach (step 814) an 
encryption key associated with that TV program file. This is particularly useful if the TV 
program is broadcast on a premium channel (the user has paid a subscription fee for viewing 
at TV 132), and the program has been encrypted using well know encryption techniques to 
25 prevent unauthorized viewing. 

[0052] In order to more completely understand this last mentioned feature of the described 
embodiment (implemented at step 814), reference can be made to Fig. 9, which illustrates the 
use of encryption for TV programming as could be implemented by the CPU 3 12 and other 
functionality within STB 166. As can be seen, the encryption/decryption functionality within 
30 the STB 166 includes a decryption function 912 for receiving an encrypted program or 

service, and providing the program in a decrypted format at its output, through the use of a 
working key provided by a security processor 914. The security processor 914 is connected 
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to memory (RAM 918 and ROM 920). The memory stores both an encrypted pre-key that is 
provided by the service provider when the user subscribes to the service, and a monthly key 
that is provided by the service provider (changed each month to make it difficult to obtain 
unauthorized access to the program). As illustrated in Fig. 10, the STB 166 uses the pre-key 
to decrypt (block 1010) the monthly key, resulting in a working key that is provided to the 
programming decryption function 912 (Fig. 9) in order to decrypt the programming signal. 
The security processor 914 controls a switch 926, so that if the user has the appropriate pre- 
key and monthly key, the decrypted programming is provided by switch 926 to TV 132 via 
the video encoder/decoder 332 (previously discussed in conjunction with Fig. 3). If the user 
is not authorized, the switch 926 provides encrypted programming (scrambled so as to not be 
viewable) to TV 132. 

10053] The encryption/decryption techniques described are well known, and techniques 
other than those described could be employed. A more detailed description of the 
functionality seen in Fig. 9 and 10 is found in U.S. Patent No. 5,594,794, issued to Eyer et al. 
on January 14, 1997, which is hereby incorporated by reference. 

[0054] As seen in Fig. 9, the video provided to TV 132 is also outputted as a file (MPEG-2 
format) to be stored within the STB 166. Such file can be accessed and then sent to another 
user as an video file attached to an instant message (step 812, Fig. 8). Further, as also seen in 
Fig. 9, the security processor 914 also supplies the working key so that it can be stored with 
the video file, for reasons to be explained shortly. 

[0055] Returning to Fig. 8, the JJvl user wanting to attach a video file then sends the 
message with the selected video file (which is now decrypted, but includes the working key 
associated with that video file), step 816. When the message and attachment are received at 
the intended destination (i.e., one of the other users on the "buddy list"), the STB 166 at that 
destination stores the video file, and compares the working key (sent with the message) to a 
working key generated at that STB, step 818. In particular, if the destination user has 
subscribed to the same premium channel, that STB at the destination takes the program pre- 
key and monthly key stored at that location for viewing encrypted programming, and derives 
a working key (see Fig. 10), and compares that working key to the working key sent with the 
) video file. It should be noted that the destination user may subscribe to more than one 
premium channel or pay-per-view channel, it which case a comparison is made of the 
working key generated for each such channel to the working key sent with the attachment. 
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At step 820, if a match is made, the video file is passed to the TV connected to the STB at 
that location; if there is no match, the video file is blocked at that location from being 
displayed. 

[0056] It is noteworthy that the use of a working key as the key or code to permit viewing 
is but one example of a process for assuring that the destination user is authorized to view the 
video file. Requiring that the destination decrypt a monthly key to yield a working key 
assures that the destination has both a monthly key and an encrypted program pre-key. 
However, in alternative embodiments, the video file could be sent with just the program pre- 
key, just the monthly key, or with any other key or code, as long as the same key or code will 
be present (or can be generated) at a destination when that destination is an authorized 
viewer/location of the channel from which the video file was originally made. 
[0057] It should be appreciated that the method described above for matching keys at the 
destination is particularly useful in the context of instant messaging, where the user sending a 
video or other protected file distributes each message to a group of users (recipients) who 
happen to be on the "buddy list", and thus where it is difficult or impractical for the user to 
ask each person whether they are authorized to view programming from a premium (or pay- 
per-view) channel, and be able to verify that each such recipient is in fact so authorized. 
[0058] Turning now to Figs. 1 1 and 12, there is illustrated an arrangement where the 
operator of the IM server 192 (or others with access to the IM server) may use data collected 
during an IM session. In particular, there is seen in Fig. 1 1 a survey database 1110 connected 
to the IM server 192. The database 1 1 10 stores data collected or gleaned from the messages 
being posted by the instant messaging services (and each of the instant messaging sessions) 
operated through use of the IM server 192. Such data can include the number of users, which 
TV programs those users are watching (based on the TV programming names or IDs 
presented with instant messages), key words present in messages, and so forth. The database 
1 1 10 is connected to a database or survey system 1 1 12, that includes a survey server 1 1 14 
which manages the database 1 1 10, an input/output terminal 1 1 16 for permitting queries and 
other actions in connection with the data, building database reports, etc., and a printer 1118 
for printing database reports, etc. 

[0059] The types of data that are collected and the reports that can be generated by the 
database system 1 1 12 are numerous. It should be appreciated that since the data collected 
relates to instant messaging being posted, TV programs being watched by the IM users, 
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telephone calls being made in association with the messages, and other data associated with 
the content of those messages, that the data is real time, i.e., reflects instantaneous activity by 
users. As an example, if a TV programming entity wants to know on an instantaneous basis 
how audiences are reacting to a broadcast program, the data generated at system 1 1 12 can be 
used by the survey system operator for such purpose. 

[0060] An exemplary report in such an instance is shown in Fig. 12, where at a given time 
(8:15PM) for a given broadcast program ("TV Show A"), a programming entity can learn 
how many users are using the IM server 192 (the total survey population), how many of those 
users are watching Show A, whether over a period of time (say, 5 minutes) the number of 
viewers is trending up or down (i.e., whether the number of viewers has increased or 
decreased), and how the TV program is impacting instant mail activity and phone activity (an 
increase in mail or phone activity by users watching Show A might indicate the degree of 
interest in the program). In addition, to the extent users have permitted profile data to be 
used (field 430 in Fig. 4), the survey organization may also learn about the demographics of 
the users being reported. All of this is real time, of course, with data changing as activity 
changes, and such instantaneous data capable of being reported as it changes. This permits 
the survey organization, for example, to note favorable or unfavorable instant messaging 
activity moment by moment, or scene by scene, as a TV program progresses. 

[0061] In conclusion, the described embodiments of the invention provide networks, 
systems and methods implementing various applications, features, and functionality relating 
to instant messaging and similar services. While the network 100 is described as employing 
VDSL service, it should be appreciated that other forms of data transmission could be 
employed. For example, the video programming or signals transmitted to the STB 166 at the 
subscriber premises (and even the voice and data signals) can be from one or more video 
sources, such as cable TV, satellite, and other forms of wireline and wireless transmission. 
Such transmission can be made in conjunction with or separately from the 
connections/transmissions between the subscriber premises and the central office 150. In 
such example, if video programming originates from a satellite system, then the NID 1 12 (in 
Fig. 1) may receive signals (e.g., voice and data) over drop cable 160 and the STB 166 may 
also separately receive video programming from a separate line (not shown) carrying video 
signals from a satellite dish at the subscriber premises. 
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[0062] Furthermore, in other embodiments, the functionality described as resident at the 
STB 166 (e.g., look up tables for telephone calling, assembling attachments and the 
corresponding encryption/decryption of video messages and keys) could be provided in part 
or in whole at the IM server 12 rather than the STB 166. 

[0063] While a detailed description of presently preferred embodiments of the invention 
have been given above, various alternatives, modifications, and equivalents will be apparent 
to those skilled in the art without varying from the spirit of the invention. Therefore, the 
above description should not be taken as limiting the scope of the invention, which is defined 
by the appended claims. 
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